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Abstract. In this report I review recent results in the field of rare decays at the Tevatron CDF II and D0 experiments. 
The presentation is focused on rare decays of charm and bottom mesons with two muons in the final state. This includes 
improvements over the previously available limits on the following branching ratios: 33{D + — » n + + < 4.7 x 10 -6 , 
SS(B Q S -> < 3.2 x 1(T 6 , S8{B° S -> M V~) < 1 x 10~ 7 , and S8(B^ d -» H + H~) < 3 x 1(T 8 all at the 90% confidence 

level. Also reported are the first direct observation of Df (j)7Z + ^ [l + [l~ 7t + with a significance above background of over 
7 standard deviations and evidence of D + (j)X + ^ jl + n + with a significance of 3.1 and -5$(D + — » <pn + — » fl + fl~7Z + ) = 
(1.75 ±0.7 ±0.5) x 10~ 6 . 
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1. INTRODUCTION 

Historically, rare decays of hadrons have been one of the main interests in the program of high energy physics (further 
information on this subject can be found in Refs. H] |2] |3] 0). Decays with substantially low rates (typically with 
branching ratios below 10~ 5 ), rare decays, not only correspond to properties and conservation laws of the Standard 
Model (SM), but also provide an invaluable tool in defining or limiting models of the New Physics (NP). Owing to the 
mass hierarchy of quarks and specifics of the quark mixing in the SM, described by the Cabibbo-Kobayashi-Maskawa 
(CKM) matrix, rare decays of heavy flavor hadrons are of the most interest. 

Based on a final state rare decays can be classified as charmless hadronic, radiative, and leptonic. Here I focus on 
leptonic decays with two muons in the final state, corresponding to Flavor Changing Neutral Currents (FCNCs). 

The FCNCs are suppressed and appear only at the loop level in the SM and vanish in the limit of zero quark masses 
(Glashow-Iliopoulos-Maiani or GIM mechanism). Suppression of the FCNCs is a paramount property of any viable 
NP model. Specific to flavor, the FCNCs correspond to b — > s(d) and to c — > u transitions for the bottom and charm 
decays respectively. While excellent agreement of the SM and experiment in processes like b — > sy, b — > sl + l~ , and 
K — ► nvv already constrains many NP models, further knowledge on FCNC decays is needed in search for the NP. 

Having a high experimental sensitivity to rare decays of heavy flavor mesons requires ability to produce a large 
number of such mesons as well as to effectively discriminate the signal from backgrounds. Bottom and charm mesons 
can be produced in abundance both at the e + e~ B- or charm factories and at the hadron colliders, like the Tevatron. 
Although the production rates of the heavy flavor are higher at the Tevatron than at the e + e~ flavor factories by far 
more abundant light flavor production puts the Tevatron on a similar level of sensitivity. Ability to produce all flavors 
puts the Tevatron on the forefront in rare decays of hadrons not easily accessible at B-factories, like B® or A^. 

Recent results reported by the CDF and D0 are presented below. I begin with highlights of detector features and 
common analysis methods. I then overview particular searches: forD — > fJ. + [J.~ at CDF II and forD + — > 7i + jJ, + jJ.^ at 
D0; for B® — > <j>jj. + n~ at D0, and for B°,,> — > fJ. + [J.~ at both experiments. This is followed by a brief conclusion. 



2. DETECTORS AND COMMON APPROACH TO RARE DECAY SEARCH 

The collider detectors a the Tevatron, CDF II and D0, described elsewhere (5]|6], are general purpose detectors each 
having parts with similar functions. Relevant to the analyses presented here are the tracker immersed in the solenoidal 
field used for precision momentum measurement of charged particles; the silicon vertex detector used to effectively 
select displaced vertices characteristic to decays of heavy flavor; and the muon detectors (located behind calorimeters 



and additional steel absorbers) used to identify muons. Rapidity and momentum coverage for muons are |tj| < 2(1) 
and px > 3(1.5) GeV/c for D0 (CDF II). Better rapidity acceptance and higher quality of the muon identification in 
D0 is levered by better tracking precision and lower momentum thresholds for muons at CDF II, which allows both 
experiments to perform at a similar level in searches for exclusive decays like Hu c ) — ► + X. 

High purity of dimuon selection allows both experiments to effectively trigger on dimuon events, which constitute 
the dimuon samples used to analyze the rare decays. In addition to the dimuon triggers, the CDF employs the displaced 
(two-) track trigger which allows to select heavy flavor decays based on the tracks of the decays products alone. 

The analyses presented here employ a relative normalization, where an abundant mode (H y — ► Y) is used to estimate 
the rate of a rare mode (H x — > X) collected in the same sample. The branching ratio of the rare mode is given by 

Jyy £x fx 

where N X [y) is the number of events or an upper limit in the rare (normalization) mode; Ex is the total efficiency, a 
fraction of observed H x — > X events relative to all such events produced (same for £y); f x i y \ is the relative production 
fraction of H,u . A benefit of this approach is that if kinematics of both modes is similar, a large part of the systematic 
uncertainty cancels in the ratio. 

The strategy of the analyses is the following. First, pick dimuon events passing baseline selections, like a noticeable 
momentum to expect a displaced decay vertex and a set of quality requirements to muons and the decay vertex. This 
gives a sample with an order of 10 3 — 10 4 events completely dominated by backgroundf^At this point the events with 
mass near the signal meson mass are hidden and the optimal choice of cuts is based on events in the sidebands used 
to predict backgrounds in the signal region and the signal itself is modeled using the Monte Carlo (MC) simulation. 
Once the optimization is done events in the signal window are uncovered and the limit on the branching ratio is set. 

3. RARE DECAYS OF CHARM MESONS 

The c-FCNCs in the SM correspond to the loop diagrams with {d,s,b} in the loop where the contribution from non- 
vanishing s-quark mass dominates. The GIM suppression works in this case due to small masses of d- and s- quarks 
and a CKM suppression of Z?-quark contribution. As a result the rare decays are dominated by long distance interactions 
(<p or other internal resonance decays to jJ, + )J,~) Q. The c-FCNCs can be enhanced in the NP models to rates as high 
as the present experimental sensitivity. A search for D° — ► at CDF II |7| and a search for D + — > n + ji + ji~ 

recently reported by the D0 [ 8 1 are reviewed briefly below. 

3.1. Search for D° -> ju+ju at CDF II 

The branching ratio of the D° — ► in the SM is about 10~ 13 (the short distance contribution is only about 

1(T 19 ) ElEl, which in addition to the GIM suppression also has a helicity suppression factor of (m^/mj)) 2 . This value 
is substantially lower than experimental limits of about 10~ 6 (including the most recent measurements |9l). 

A search for D° — > decay was performed at CDF II using 68 pb with normalization to D° — > n + n~ 

(£8 ~ 1.4 x 10~ 3 ) with events from the two-track trigger sample. The data with reconstructed jJ. + fJ.~ in the region 
within 22 MeV/c 2 (2a) of the mass of D were hidden during the optimization. Two backgrounds contributed in this 
case: combinatorial (estimated from the high-mass sideband) and mis-identification of D° — > n + n~ as D° — > . 

To discriminate signal from background the following variables were used: azimuthal angle between the extrap- 
olated positions of the tracks at muon chambers (A0), impact parameter of the candidate (d xy ) and its decay length 
projected onto its transverse momentum (L xy ) both in the plane transverse to the beam. Values of the cuts where chosen 
to maximize 5/(1.5 + \/^gd), where S(iVbgd) is the number of signal (background) events corresponding to the best 
limit at 99.7% confidence level (C.L.). The optimization yields^] |A0| > 0.085, \d„\ < 150 jum, and L xy < 0.45 cm. 

After applying the optimal requirements 5 events are left in the high-mass dimuon sideband and 1412 ±54 events 
are observed in D° — > n + n~ mode, which corresponds to expected A^gd of (1.6±0.7) com t,. + (0.22 ±0.02) m i s _j<j = 



The potential sources of combinatorial background are sequential semileptonic b — > c — > s decays, double semileptonic bb — > jl^ fl X decays, 
and events with charged particles mis-identified as muons (fake muons). 
- Note that at the trigger level the candidates are required to have L xy > 200 flm. 



1.8 ±0.7. No events were observed in the data, corresponding to the upper limit of 2.5 x 10~ 6 at 90% C.L. This 
measurement was superseded by a limit of 1.3 x 10~ 6 at 90% C.L. reported in Ref. [9]. With more than 1 fb _1 of data 
collected by CDF II a substantial improvements to the limit is expected with an updated analysis. 



3.2. Search for D+ -> ^:+ i u+/i at D0 

Decays of D + and Df to jJ, + jJ,~h + , where h is a kaon or a pion, are driven by long distance interactions in the SM. 
Their branching ratios in the SM range from 6.1 x 10~ 6 for D+ -> n + fi + fi-, and 1 x 10~ 6 for D+ -> n+fi+fi- to 
7.1 x 10~ 9 for D + — > K + ii + pL~, with significant short-distance FCNCs only in D + — > 7t + fi + ^ {S3 ~ 9.4 x 10" 9 ) 
and D+ — > K + jj, + jj,~ (£S ~9x 10~ 10 ) [8 1. Previous searches for these modes reveal limits of the order of 10~ 5 . 

A search for short-distance (off 0-resonance) decay D + — > n + fl + fl~ was done by D0 using 1 ftr 1 ofdataEl.The 
analysis was performed in two stages: the branching ratio of D + — > n + pL + pL~ on (j) resonance (with 0.96 < < 
1.06 GeV/c 2 ) was measured first normalized to Df — > n + n + ji~; then the Z) + — > n + ji + n~ off resonance was 
searched for normalized to the resonant part. The data sample was collected using the dimuon trigger. 

The following variables were used to discriminate signal from background. Decay vertex significance, Sd, and 
significance of the impact parameter of the pion track, S K , both in the plane transverse to the beam. Collinearity or 
angle between the D-candidate momentum and the vertex displacement from the beamline, ©£>. Track isolation of 
the candidate, Id = p(D)/Y*p, where the sum is over tracks with AR = ^ At] 2 + A<j) 2 < 1 relative to the candidate 
momentum. Quality of the candidate, = j 2 tx + 1/Pr n + ^tc> where Xvtx i s f° r tne fit to the decay vertex, pj K is a 
transverse momentum of the pion in GeV /c, and AR K is the distance of the pion track from the dimuon system. 

The optimization of these cuts was performed to maximize e/(0.82 + y^Vj^d), where e is the signal efficiency 
(relative to preselections of Id > 0.4, So > 3, S K > 0.5, and &d < 50 mrad), which corresponds to the maximum 
expected upper limit at 90% C.L.. The cuts chosen as a result of the optimization are Id > 0.44(0.71), So > 3.4(9.4), 
S n > 0.57(1.8), ©£> < 32(7) mrad, and j& < 6.1(2.6) for the on-resonance (off-resonance) measurement. 

The D-candidate mass spectra for on- and off-resonance after the optimal selections are shown in Fig. [T] For 
the on-resonance case the fit yields 65 ±11 Df events and 26 ±9 D + events, which corresponds to about la and 
3.1(7 significance for D+ and D + respectively. The corresponding measurement is 3§{D + — > (j)7Z + — > pL + jl~n + ) = 
( 1 .75 ± 0.7 ± 0.5) x 10~ 6 , consistent with simple factorization of two sequential decays, and can be compared to the 
recent CLEO-c measurement of (2.7 j^;f ±0.2) x 10~ 6 . Off- resonance, the number of observed events in the signal 
window is 17 consistent with ,/V bgd = 20.9±3.4, corresponding to 33(D + — > ^+ J u+ J u _ ) < 4.7 x 10~ 6 at 90% C.L. 

4. RARE DECAYS OF BOTTOM MESONS 

Rates of the b-FCNCs in the SM are higher than of the similar c-FCNCs and some are within the present experimental 
sensitivity, like b — > sy and b — > sl + l~ in B + and B° decays [1|. This is because the GIM suppression is not effective 
due to the top-quark in the loop. In the NP models the fo-FCNCs can be enhanced by large factors. The results of 
searches for B® — > <j)jj, + jj.^ at D0 and for B®,,-. — > fJ. + H~ at both experiments are discussed below. 



4.1. Search for -»■ <^/i + Ai at D0 

In the SM, the rate of the B® — > neglecting the interference effects with B° — > J/\j/(j) P~6x 10 -5 0) 

and B® — > 1/^(25)0 (f ~4x 10 -6 (31) resonant decays, is predicted to be about 1.6 x 10^ 6 (10). The previously 
published limit of 3§(B® -> fl+^ij)) < 6.7 x 10~ 5 at 95% C.L. comes from CDF I. This decay is related to b — > sl + l 
transition and by its properties is similar to the observed B® d — > K*l + l~ {£$ = (1.46±0.25) x 10~ 6 0). Observation 
of B® — > <j)ji + n~ and analysis of its kinematics will add important information on the flavor dynamics of fr-FCNCs. 

The D0 Collaboration has performed a search for B® — > using 0.45 ftr 1 HO) with fl° -> 7/v/0 used for 

normalization. The events were collected from the dimuon trigger sample in the range of 0.5 < < 4.4 GeV/c 2 
and with the <j) -candidate mass within 1008 < < 1032 MeV/c 2 . With an addition of a good decay vertex and 
Pj>5 GeV/c requirements this defined the baseline sample of 2602 events. At this point the events in the signal 
window within 188 MeV/c 2 (2.5(7) from the world-average m B o were hidden from the optimization. The B® — > J/ytj) 
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FIGURE 1. The /%+„+„- mass spectrum for the optimized on-resonance (left) and off-resonance (right) selection criteria. The 
curve on the left plot is the result of the fit to contributions from D + , Df, and combinatoric backgrounds. 



events are required to pass the same cuts as the signal except for the dimuon mass to be consistent with //<//. In the 
signal mode events with 2.72 < < 4.06 GeV/c 2 corresponding to charmonium resonances were removed. 

The following variables were used to further discriminate signal from background with values chosen to maximize 
£ /(l + y^bgd) (corresponding to the best limit at 95% C.L.), where e is the signal efficiency relative to the baseline 
selections. Collinearity or pointing angle between the candidate momentum and the displacement of the decay vertex 
from the beamline, ®b- Significance of the candidate decay length, Sb- The track isolation, Ig = Pb/(j>b+YiP)> where 
the sum is taken over non-candidate tracks momenta with AR < 1 relative to the direction of the candidate momentum 
Pb- The optimal cuts were shown to be: Sb > 10.3, Is > 0.72, and < 0.1 rad. 

In the data 73 ± 10 ±4 and zero events pass the optimal selections in B® — > J/\lf(j) and the signal modes respectively 
with an expected N bgd of 1.6 ±0.4 and e » 54%. The resulting limit is 3§{B° S -> < 3.2 x 10~ 6 at 90% C.L., 

which is only about a factor of two above the SM value and is substantially better than the previously published limit. 



4.2. Search for 5" ^ — > jU+jU 

In the SM, the branching ratio of Z?° (BP d ) decay to ju + pi~ is about 4 x 10~ 9 (1 x 10~ 10 ) 0], which is helicity- 
suppressed by a factor of (m^/m^) 2 . Compared to the B® — > jJ. + jJ.~, the B d — > mode is further suppressed by 

a factor of (V t d/V ts ) 2 ~ 0.04. The present experimental sensitivity to B® — > of about 10~ 7 already becomes 

important in constraining NP scenarios. In the MSSM with large tan/3 the dominant contribution is from a heavy 
neutral Higgs exchange (proportional to tan 6 /3 /»%), which, considering other constraints, can be as large as the 
current sensitivity. Observation of the — > at the Tevatron would be an unequivocal indication of the NP. 

The D0 reported a search for B® — > H + jJ.~ using 300 pb -1 (the first sample) ifTTI . and a sensitivity study using 
additional 400 pb -1 (the second sample) |[T2l . The CDF reported results based on 780 pb~' [13], using the method as 
in the previous study detailed in [4|. Both experiments used dimuon trigger samples and normalized to B + — > J/yK + . 



4.2.1. Search for B° s -> jU + /i~ at D0 

With a dimuon mass resolution near Z?^ mass of about 90 MeV/c 2 B® and Z?') can not be separated. Thus, assuming 
the contribution from Z?') is small, the search is targeted on B® . The preselection of B® candidates is made from dimuon 



events with 4.53 < < 6.15 GeV/c 2 and each muon with pj > 2.5 GeV/c. The candidates are required to have a 
good decay vertex and pj > 5 GeV/c. These selections leave about 4 x 10 4 events in the first sample (slightly more in 
the second sample). At this point events within 270 MeV/c 2 from B® mass are hidden from the optim izati on procedure. 

The cuts on variables S B , ®b, an d Ib are chosen to maximize e/( 1 + yWbgd) (denoted as in Section|4.l|. The optimal 
cuts for the first (second) data sample are: I B > 0.56(0.59), S B > 18.5(19.5), and @ B < 0.2(0.18) rad - ^ 

The events in the B + — > J/yK + normalization mode are required to pass the same selections as the signal mode, 
except for the dimuon mass to be consistent with J/y/, and an addition of kaon track with pj > 0.9 GeV/c. 

After applying the optimal selections the number of B + — > J/y/K + events is 741 ± 31 ± 22 (899 ± 37) in the first 
(second) data sample. In the signal window within 180 MeV/c 2 from the B® mass the A^, g d is 4.3 ±1.2 (2.2 ± 0.7) 
in the first (second) sample. In the signal region 4 events are observed in the first data sample, corresponding to 
S3(B ( l — > jU + jU~) < 4 x 10~ 7 at 95% C.L. The signal region in the second sample remains hidden pending a decision 
on improvements to the analysis. The expected limit using both samples is {3§{B° S -> M + M~)) < 2.3 x 10~ 7 at 95% C.L. 



4.2.2. Search for BP, „ -> at CDF II 

The baseline sample is selected from events with dimuon mass within 4.669 < < 5.969 GeV/c 2 and each 
muon with pj > 2 GeV/c. The B-candidates are required to have pj>4 GeV/c, rapidity in range \y B \ < 1, and a 
decay vertex displaced from the production vertex by 2a. In addition the B-candidates are required to have a pointing 
angle (between the candidate momentum and the decay vertex displacement) in range © < 0.7 rad and a track isolation 
(/ = Pt/(Pt~\~YiPt)> where the sum is taken over non-candidate tracks with AR < 1 relative to the momentum of the 
candidate) in range / > 0.5. At this point, out of 23066 events left, events with 5.169 < M M/i < 5.469 GeV/c 2 (the 
signal window is ±60 MeV/c 2 or 2.5a around m B o or m B o) are hidden from the optimization procedure. 

The B + — ► J/y/K + events are required to pass the same baseline selections, except for the dimuon mass to be 
consistent with J/y/, and the kaon track passing pj > 1 GeV/c. After sideband subtraction and a small correction for 
B + — > J/\j/7Z + , the number of B + — > J/\j/K + events is estimated to be 5763 ± 101, as shown in Fig. [2] 

The following variables are used to discriminate signal from the background: / and (defined above); and the 
proper lifetime of the candidate A = c(L ■ p)M flf i/(p) 2 , where L is the displacement of the decay vertex. For a better 
discriminating power variables /, ©, and P(X) = exp(— X/cTb) (where x B is the world average lifetime) are 

combined into a likelihood ratio defined as Lr = TlP s (xi) / (YlPs{ x i) +YlPb( x i))> where P s ^(xi) is the probability for 
signal (background) of a variable x, (one of the three). The optimal cut is chosen to minimize the expected upper limit 
on 3§{B° s[d) -> at 90% C.L., and is found to be L R > 0.99. 

Two background contributions are considered: combinatorial and mis-identification. The mis-identification (B — > 
reconstructed as ) is irreducible and is estimated using the mis-identification rates (measured from data as 

in 0) and assuming the same selection efficiency for B — * hhS'> and B°, d -, — > (except for the mass selection). 

After applying the optimal cut 1.1 ±0.4 combinatorial background events are expected in the signal region, same 
for£? andB°. The mis-identification background is 0.2 ±0.1 events for B° s and 1 .4 ± 0.2 for B® { . In data 1 (2) events 
pass the optimal cut in the B® {B° d ) signal window, as shown in Fig.|2j corresponding to 3$(B^ — ► < 1.0 x 10~ 7 

and -S8(B a d — > ^ + jU~) < 3.0 x 10~ 8 at 95% C.L. These results improve the previous results HUE] by a factor of two 
and can be used to reduce the allowed parameter space of a broad spectrum of SUSY models 

Both CDF and D0 limits on B® — > can be combined as independent measurements to get a better limit ifTSI . 

With more data it is expected that the combined sensitivity would reach the level of 1 x 10~ 8 by the end of Run II [4|, 
which would make the B° s — > mode a powerful probe in the search for the New Physics. 



5. CONCLUSION 

Study of rare decays of the heavy flavor is a substantial part of the program of the CDF II and D0 experiments. 
Owing to the high production cross section of all heavy flavor species in the pp collisions and to the efficient selection 
methods it is possible to study rare decays not available at other experiments as B-factories. With the continuously 
increasing amount of data provided by the Tevatron and improvements of the analyses the power of the experiments 
continues to grow allowing for some of the world best results. New results are available for FCNC decays in both charm 
and bottom sectors with substantial improvements in the following upper limits: D + — * n + jj, + jj,~ (08 < 4.7 x 10~ 6 
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FIGURE 2. The mass spectrum for B + —* J/\ffK + candidate events (left), and the distribution of likelihood value versus dimuon 
mass for the B° — > fJ. + [i candidate events (right). 



at 90% C.L.), Bj -> <$>li + li- (S§ < 3.2 x 1(T 6 at 90% C.L.), and B°, d) -> jx+pt- -> < 1 x 10~ 7 and 

■S8{B G d — > < 3 x 10~ 8 at 90% C.L.) decays. In addition, Df — > <j)7Z + — > fi + /j.~7t + decay was observed with a 

significance over 7<T, and evidence of the decay of D + into the same final state was reported with a significance of 
3.1(7 and S8{D+ — > — * \L + \T% + ) = (1.75 ±0.7 ±0.5) x 10~ 6 . Improving sensitivity to B®, — > makes this 

decay one of the most powerful probes of SUSY with large tan j3 . These results provide new insight into the properties 
of the FCNC decays, which allows for improved tests of the SM and could ultimately guide us to the New Physics. 
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